Extracting dynamical equations from experimental data is NP-hard 
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The behavior of any physical system is governed by its underlying dynamical equations. Much of physics is 
concerned with discovering these dynamical equations and understanding their consequences. In this work, we 
show that, remarkably, identifying the underlying dynamical equation from any amount of experimental data, 
however precise, is a provably computationally hard problem (it is NP-hard), both for classical and quantum 
mechanical systems. As a by-product of this work, we give complexity-theoretic answers to both the quantum 
and classical embedding problems, two long-standing open problems in mathematics (the classical problem, in 
particular, dating back over 70 years). 



A large part of physics is concerned with identifying the 
dynamical equations of physical systems and understanding 
their consequences. But how do we deduce the dynamical 
equations from experimental observations? Whether deduc- 
ing the laws of celestial mechanics from observations of the 
planets, determining economic laws from observing monetary 
parameters, or deducing quantum mechanical equations from 
observations of atoms, this task is clearly a fundamental part 
of physics and, indeed, science in general. The task of identi- 
fying dynamical equations from experimental data also turns 
out to be closely related, in both the classical and quantum 
mechanical cases, to long-standing open problems in mathe- 
matics (in the classical case, dating back to 1937 Ij]]). 

In this letter, we give complexity-theoretic solutions to both 
these open problems. And these results lead to a surprising 
conclusion: regardless of how much information one obtains 
through measuring a system, extracting the underlying dy- 
namical equations from those measurement data is in general 
an intractable problem. More precisely, it is NP-hard. This 
means that any computationally efficient method of determin- 
ing which dynamical equations are consistent with a set of 
measurement data would solve the (in)famous P versus NP 
problem 12], by implying that P=NP. Thus, if P^^NP, as is 
widely believed, there cannot exist an efficient method of de- 
ducing dynamical equations from any amount of experimental 
data. We also prove the other direction: by reducing to an NP- 
complete problem we show that, if P=NP, then there does ex- 
ist an efficient algorithm for extracting dynamical equations 
from experimental data. Thus the question of whether there 
exists an efficient method for determining dynamical equa- 
tions from measurement data is equivalent to the P versus NP 
question. 

Note that we are not restricting ourselves here to fundamen- 
tal theories, where other theoretical considerations may im- 
pose simplifications on the desired form of the equations. We 
are also considering effective dynamical equations, as encoun- 
tered in the majority of experiments, where the full range of 
possible dynamical equations can in principle be observed. 

In the classical setting, the problem of extracting dynami- 
cal models from experimental data has spawned an entire field 
known as system identification yD, which forms part of con- 



trol engineering - after all, the precise knowledge of the dissi- 
pation is crucial for actually understanding what control steps 
to apply. In the quantum case, interest in understanding quan- 
tum dynamics, especially externally-induced noise and deco- 
herence, has been spurred on by efforts to develop quantum 
information processing technology j^]^- Indeed, the primary 
goal of many experiments is precisely to characterize and un- 
derstand the dynamics of a specific quantum system J wlOll . 
This is precisely the task that we show to be computationally 
intractable in general (assuming P^^NP), both in quantum me- 
chanics and in classical physics. 




FIG. 1 . In an experiment, we can gather snapshots of the state of a 
physical system at various points in time. To understand the physics 
behind the system's behavior, we must reconstruct the underlying 
dynamical equations from the snapshots. 

Results. Let us make the task more concrete. We will 
throughout consider ope« system dynamics which takes exter- 
nal influences and noise into account. Recall that in classical 
mechanics, the most general state of a system is described 
by a probability distribution p over its state space, which for 
simplicity we will take to be finite-dimensional. Its evolution 
is then described by a master equation, whose form is deter- 
mined by the system's Liouvillian, corresponding to a matrix 
L, as p = Lp. The Liouvillian expresses interactions, con- 
servation laws, external noise etc., in short, it describes the 
underlying physics. In order for the probabilities to remain 
positive and sum to one, the elements L^ j must obey two sim- 
ple conditions lllll : (i) Li^j > 0, (ii) ^^ Lij = 0. 

In the quantum setting, the density matrix p plays the anal- 
ogous role to that of the classical probability distribution, but 
the quantum master equations are still determined by a Liou- 



villian: 



p^C{p). 



(1) 



In his seminal 1976 paper 111211 . Lindblad established the gen- 
eral form that any quantum Liouvillian must take if it is to gen- 
erate a completely-positive trace-preserving evolution (so that 
density matrices always evolve into density matrices, directly 
analogous to probabilities remaining positive and normalised 
in the classical case): 



t^ip) 






Here, H is the Hamiltonian of the system, G is a positive semi- 
definite matrix and, along with the matrices F^, describes de- 
coherence processes. ([., .] and {., .}+ denote respectively the 
commutator and anti-commutator.) These master equations 
of Lindblad form have become the mainstay of the dynami- 
cal theory of open quantum systems, and are crucial to the 
description of quantum mechanics experiments lll3ll . In prin- 
ciple, the Liouvillian could itself be time-dependent, describ- 
ing a system whose underlying physics is changing over time. 
Here, we restrict our attention to the problem of finding a time- 
independent Liouvillian, as this is a good assumption for ex- 
periments in which external parameters are held constant. The 
more general time-dependent problem is expected to be harder 
still. 

What is the best possible data that an experimentalist can 
conceivably gather about an evolving system? At least in prin- 
ciple, they can repeatedly prepare the system in any chosen 
initial state, allow it to evolve for some period of time, and 
then perform any measurement. In fact, for a careful choice 
of initial states and measurements, it is possible in this way to 
reconstruct a complete "snapshot" of the dynamics at any par- 
ticular time. In the quantum setting, this technique is known 
as quantum process tomography 15[]. Quantum process tomog- 
raphy is now routinelycarried out in many different physical 
systems, from NMR la, 13] to trapped ions 18|], from photons 
111 to solid-state devicesfiol. 

A tomographic snapshot tells us everything there is to know 
about the evolution at the time t when the snapshot was taken. 
Each snapshot is a dynamical map £t, which describes how 
the initial state, po or po, is transformed into p{t) = £t{Po) 
or p{t) = Etipo). Any measurement at time t can be viewed 
as an imperfect version of process tomography, giving partial 
information about the snapshot, and the outcome of any mea- 
surement of the system at time t can be predicted once £t is 
known. Thus the most complete data that can be gathered 
about a system's dynamics consists of a set of snapshots taken 
at a sequence of different points in time. 

Let us concentrate first on the quantum case. Quantum 
dynamical maps £t are described mathematically by com- 
pletely positive, trace-preserving (CPT) maps [SJ] (also known 
as quantum channels). The problem of deducing the dynami- 
cal equations from measurement data is then one of finding a 



Lindblad master equation ([T]i that accounts for the CPT snap- 
shots Et- This is essentially the converse problem to that con- 
sidered by Lindblad 1121 11411 . Given its relevance, it is not 
surprising that numerous heuristic numerical techniques have 
been applied to tackle this problem |l7l[l5|l. But unfortunately 
these give no guarantee as to whether a correct answer has 
been found. Our results show that the failure of these heuris- 
tic techniques is an inevitable consequence of the inherent in- 
tractability of the problem. 

Before tackling the problem of finding dynamical equa- 
tions, let us start by considering an apparently much simpler 
question: given a single snapshot £, does there even exist a Li- 
ouvillian C that could have generated it? Not every CPT map 
£ can be generated by a Lindblad master equation ilallTT . so 
the question of the existence of such a Liouvillian (Eq. (|2|)) is 
a well-posed problem. A dynamical map that is generated by 
a Lindblad form Liouvillian is said to be Markovian, so this 
problem is sometimes referred to as the Markovianity problem. 
Non-Markovian snapshots |18T can arise if the environment 
carries a memory of the past, so that the system's evolution 
cannot be described by Eq. (uJ) in the first place, as that as- 
sumes the system is sufficiently isolated from its environment 
for its dynamics to be described independently. 

It is important to note that, for the results to apply to real 
experimental data, we must take into account the fact that a 
snapshot can only ever be measured up to some experimental 
error. We should therefore be satisfied if we can answer the 
question for some approximation £' to the measured snapshot 
£, as long as the approximation is accurate up to experimental 
error. Mathematically, this is known as a weak membership 
formulation of the problem. 

To address the Markovianity problem, we will require some 
basic concepts from complexity theory. Recall that P is the 
class of computational problems that can be solved efficiently 
on a classical computer The class NP instead only requires an 
efficient verification of solutions, and contains problems that 
are believed to be impossible to solve efficiently, such as the 
famous 3 SAT problem, and the travelling salesman problem. 
A problem is NP-hard if solving it efficiently would also lead 
to efficient solutions to all other NP problems. A problem 
that is both NP-hard and is also itself in the class NP is said 
to be NP-complete. The 3SAT and travelling salesman prob- 
lems are both examples of NP-complete problems, whereas 
the problem of factoring large integers is an example of an NP 
problem that is believed not to be NP-hard 11911 . 

Rather than considering 3 SAT, it is more convenient here 
to consider the equivalent 1-IN-3SAT problem, into which 
3 SAT can easily be transformed 11911 . and which is therefore 
also NP-complete. We will show that any instance of the 1 -IN- 
3 SAT problem can be efficiently transformed into an instance 
of the Markovianity problem (see also 120(1 ). thus proving that 
the latter is at least as hard as 1 -IN-3S AT; any efficient proce- 
dure for determining whether a snapshot has some underlying 
Liouvillian would immediately imply an efficient procedure 
for solving 1-IN-3SAT. But 1-IN-3SAT is NP-complete, so 
this would immediately give an efficient algorithm for solv- 



ing any NP-problem, implying P=NP. However, as discussed 
above, the Markovianity problem is just a special case of the 
more general — and more important — problem of extracting 
the underlying dynamical equations from experimental data. 
If Ft^NP, as is widely believed, then there cannot exist a com- 
putationally efficient method of deducing dynamical equations 
from any amount of experimental data. 

We can go further than this. Through the relation to NP- 
complete problems such as 1- IN- 3 SAT, we can reduce the 
Markovianity problem to the task of solving an NP-complete 
problem. This gives the first rigorous, provably correct algo- 
rithm for extracting the underlying dynamical equations from 
a set of experimental data, albeit one that is necessarily inef- 
ficient for systems with more than a few degrees of freedom 
(otherwise we would have proven P=NP!). 

We have focussed so far on the more complex case of quan- 
tum systems, and one might perhaps expect that systems gov- 
erned by classical physics would be easier to analyse. How- 
ever, essentially the same argument proves that exactly the 
same results hold for classical systems, too. (See also 12011 .) 

The technical argument. It is convenient to represent a 
snapshot £ of the dynamics of a quantum system (a CPT map) 
by a matrix E, 



a set of integers rric. 



E, 



i,j:k.l 



Tr[£{\^){J\)■\k){l\] 



(3) 



(the row- and column-indices of E are the double-indices i, j 
and k, I, respectively). Looked at this way, each measurement 
that is performed pins down the values of some of these matrix 
elements 15|] . A snapshot of a Markovian evolution is then one 
with a Liouvillian £ (represented in the same way by a matrix 
L) such that E = e^, and, for all times t > 0, Et = e^* are 
also valid quantum dynamical (CPT) maps. 

The Markovianity problem can be transformed into an 
equivalent question about the Liouvillian. Inverting the re- 
lationship E — e^, we have L = logE. There are, how- 
ever, infinitely many possible branches of the logarithm, since 
the phases of complex eigenvalues of E are only defined 
modulo 2Tri. The problem then becomes one of determining 
whether any one of these is a valid Liouvillian (i.e. of Lind- 
blad form (|2|i). This translates into the following necessary 
and sufficient conditions on the matrix L JITII : 



(i). L is Hermitian, where T is defined by its action on 
basis elements: \i,j){k,l\ = \i,k){j,l\. 



(ii). L fulfils the normalisation {oj\ L = 0, where \oj) = 
X); \hi) /yd is maximally entangled. 

(iii). L satisfies conditional complete positivity (ccp), i.e. 

(1 - UJ)L^{1 - Cj) > 0, LU= \uj)(iu\. 

All branches L,n of the logarithm can be obtained by adding 
integer multiples of 27ri to the eigenvalues of the principle 
branch Lq, so we can parametrise all the possible branches by 



C 



(4) 



(5) 



with \lc) and (rd the left- and right-eigenvectors of E. F is 
the operation ]F{\i,j){k,l\) = \j,i){l,k\*, where * denotes 
the complex-conjugate, and we have already restricted the 
parametrisation to logarithms that satisfy conditionl(i)i 

We will prove that this Liouvillian problem is NP-hard, by 
showing how to encode any instance of the NP-complete 1 -IN- 
3SAT problem into it. Recall that the task in 1-IN-3SAT is 
to determine whether a given logical expression can be sat- 
isfied or not. The expression is made up of "clauses", all 
of which must be satisfied simultaneously. Each clause in- 
volves three boolean variables (variables with values "true" or 
"false"), which can be represented by integers rric = 0, 1. In 1 - 
IN- 3 SAT, a clause is satisfied if and only \f exactly one of the 
variables appearing in the clause is true (as opposed to 3 SAT, 
in which at least one must be true), and no boolean negation 
is necessary. Note that, in terms of integer variables 7tIc, a 1- 
IN-3SAT clause containing variables rrii, rrij and m^ can be 
expressed as 



1 < TTii + rrij + TOfc < 1, 

< TTli, ?Tij, TOfe < \. 



(6a) 
(6b) 



If the matrices appe aring in conditions |£/j to \(iiih were di- 
agonal, condition \{m\ would give us a concise way of writ- 
ing the coefficients and constants of a set of inequalities such 
as Eqs. (|6|) in the diagonal elements. However, the problem 
we are facing here is significantly more chall engi ng: diagonal 
matrices will never satisfy conditions [{ij and Kiij and the ma- 
trices Lq and A^'''' cannot be chosen independently, since they 
are determined by the eigenvectors and eigenvalues of a single 
matrix E. 

These substantial obstacles can be overcome, however The 
key step in encoding the above boolean constraints in a quan- 
tum Liouvillian is to restrict our attention to matrices Lq and 
A^'^'i with the following special forms: 

Lo = 27r;^Q,j |z,z)(j, j| +27r^P,,j \i,j){i,3\ , (7) 
^W=27^5]4'^)|^,^)0•,J|, (8) 

with coefficient matrices 



E 



v^v"^ I 



1 1 
1 1 



k + A,- A,. 
Xr k + A,, 



E 

c 

E 



B(c) 



T 



v,.vj ® 



T 



1 -1 
-1 1 



1 
-1 

1 
-1 



1 
-1 



k - 
1 

3 

k 

k 



(9) 



(10) 



The sets of real vectors {vr} and {vc, Vc'} should each form 
an orthogonal basis, and the parameters k, Xr and Pij are 
also real. The advantage of this restriction is that the action 
of the r operation on matrices of this form is somewhat easier 
to analyse, as can readily be seen from its definition (given in 
conditionliij, above). 

It is a simple matter to verify that the eigenvalues and eigen- 
vectors of Lq and B^'^^ do indeed parametrise the logarithms 
of a matrix E, and that the Her miticity and normalisation con- 
ditions conditions [{ij and Kiill necessary for L to be a valid 
quantum Liouvillian are indeed satisfied by the forms given 
in Eqs. CZl) to dlOb . as long as w^Q ~ and diag(P)'^ is Her- 
mitian (where for rf-dimensional Q, w ~ {1,1, . . . , X)^ j\fd, 
and diag(P) denotes the d^-dimensional matrix with Pij 
down itsmain diagonal). Furthermore, the ccp condition con- 
dition l(iii)l reduces for this special form to the pair of condi- 
tions: 

^4'^me + Q,.,>0 I +3, (11a) 

C 

(1 - ww^) (diag Q + offdg P) (1 - ww^) > 0, (1 lb) 

where M = (diag Q + ofFdg P) denotes the d-dimensional 
matrix with diagonal elements Mi,i = Qi^i and off-diagonal 
elements Mi^j = Pij. 

We now encode the coefficients of the l-in-3SAT problem 
from Eqs. (|6|) into the elements of Vc- For each clause in 
Eq. (l6al) . write a "1" in a new element of Vi, Vj and Vk, and 
a "0" in the corresponding element of all other VcS- For each 
Vc, write a "1" in a new element of the vector, writing a "0" in 
the corresponding element of all the other VcS (these elements 
will be used to restrict each rric to the values or 1). Finally, 
extend the vectors so that they are mutually orthogonal and 
have the same length, which can always be done. One can 
now verify directly that, by choosing appropriate V r, Eq s. (|6|) 
are equivalent to the l-in-3 SAT inequalities of Eq. dllbb . Fur- 
thermore, conditions|£iJ and l(ii)l are always satisfied. (See 12011 
for more detail.) Thus we have succeeded in encoding 1-in- 
3SAT into the Liouvillian problem. As the latter is equivalent 
to the Markovianity problem, this proves that the Markovian- 
ity problem is itself NP-hard. This construction easily gen- 
eralizes to the original question of finding which dynamical 
equations (if any) could have generated a given set of snap- 
shots j2(||: any method of finding dynamical equations consis- 
tent with the data would obviously also answer the question 
of whether these exist, allowing us to solve all NP problems. 

Note that, on the positive side, by carrying out a brute-force 
search for solutions of the corresponding satisfiability prob- 
lem (in the case considered above, this is 1-IN-3SAT, but 
more generally it is an integer s emi-d efinite constraint prob- 
lem defined by conditions [{ij to l(iii)l which is obviously in 
NP), we immediately obtain an algorithm for extracting dy- 
namical equations from measurement data that is guaranteed 
to give the correct answer. Although such an algorithm will 
not work in practice even for moderately complex systems, the 
NP-hardness proves that we cannot hope for an efficient algo- 
rithm (unless P=NP). And it can be applied to systems with 



few degrees of freedom, making it immediately applicable at 
least to many current quantum experiments. 

What of the classical setting? The classical analogue of 
the Markovianity problem is the so-called embedding problem 
for stochastic matrices, originally posed in 1937 y]]. Despite 
considerable effort plj] the general problem has, however, re- 
mained open until now I22i\ ■ Strictly speaking, the quantum re- 
sult does not directly imply anything about the classical prob- 
lem. Nevertheless, the arguments we have given in the more 
complicated quantum setting can straightforwardly be adapted 
to the classical embedding problem 120(1 . proving that this is 
NP-hard, too. (See Q for details.) 

Discussion. On the one hand, this work leads to a rigor- 
ous algorithm for extracting the underlying dynamical equa- 
tions from experimental data. For systems with few effective 
degrees of freedom, as encountered for example in all quan- 
tum tomography experiments to date J wlOll , this gives the 
first practical and provably correct algorithm for this key task. 
For systems with many degrees of freedom, the algorithm is 
necessarily inefficient, with a run-time that scales exponen- 
tially. But our complexity-theoretic NP-hardness results show 
that we cannot hope for a polynomial-time algorithm. Note 
also that the hardness cannot be attributed to allowing high- 
energy processes in the dynamics (high branches of the log- 
arithm), as the reduction from the 1-IN-3SAT problem only 
needs low-energy dynamics (m is restricted to or 1). 

On the other hand, our results also prove that for general 
systems, deducing the underlying dynamical equations from 
experimental data is computationally intractable, unless one 
can show that P=NP. This hardness result is true whether the 
system is quantum or classical, and regardless of how much 
experimental data we gather about the system. These results 
also imply that various closely related problems, such as find- 
ing the dynamical equation that best approximates the data, or 
testing a dynamical model against experimental data, are also 
intractable in general, as any method of solving these prob- 
lems could easily be used to solve the original problem. 

Experience would seem to suggest that, whilst general clas- 
sical and quantum dynamical equations may be impossible to 
deduce from experimental data, the dynamics that we actu- 
ally encounter are typically much easier to analyse. Our re- 
sults pose the interesting question of why this should be, and 
whether there is some general physical principle that rules out 
intractable dynamics. 
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SUPPORTING MATERIAL 

Encoding 3 SAT in a Liouvillian 

We start from the special form for the matrices Lq and A^'^' 
defined in the main text: 

Lo = 27r^Q,,,|z,i)(j, j|+27r^P,,, |i,j)(i,j|, (1) 



(2) 



with 



o-E''.-<«(;;)«fn''.+'A, 



Y.^'c^c 



-i"i)Kii' ''' 



Y^ T f I ~l\ ^ fk 



k 



1 -1 






1 



(4) 



Recall that the ccp condition (iii), given on page 3 of the main 
text, reduces for this special form to the pair of conditions; 



E^l^-^ 



Q.J > i^j, 



(5a) 



(1 - wuF) (diag Q + offdg P) (l - wuF) > 0. (5b) 

As explained in the main text, we encode a 1- IN- 3 SAT 
problem into these matrices by writing the clauses into the 
vectors Vc- Denote the total number of variables and clauses 
by V and C, respectively. For each clause n involving the i^^, 
j"^ and k^^ boolean variables, write a "1" in the ?i*'^ element 
of Vi, Vj and Vk, and write a "0" in the same element of all 
the other Vc's- Now, for each Vc, write a "1" in its C + c'th 
element, writing a "0" in the corresponding element of all the 
other vectors. Finally, extend the vectors so that they are mu- 
tually orthogonal and have the same length, which can always 
be done. This produces vectors with at most C + 2V elements. 

This procedure encodes the coefficients for the 1 -IN-3S AT 
inequalities into some of the on-diagonal 4x4 blocks of the 
S'"^) matrices. Specifically, if we imagine colouring B'*^' in a 
chess-board pattern (starting with a "white square" in the top- 
leftmost element), then the coefficients for one 1-IN-3SAT 
constraint from Eq. (7) of the main text are duplicated in all 
the "black squares" of one diagonal 4x4 block. 

Colouring Q in the same chess-board pattern, the contribu- 
tion to its "black squares" from the first term of Eq. (jj) is 
generated by the off-diagonal elements A^: 



E 



T 



1 1 
1 1 



A, 



A, 



1 1 
1 1 



1 



(6) 



Since Vr and A^ can be chosen freely, the first tensor factor 
in this expression is just the eigenvalue decomposition of an 
arbitrary real, symmetric matrix S. If we choose the first C 
diagonal elements of S to be 1/2, and choose the next V di- 
agonal elements to be 5/6, then it is straightforward to verify 
that the equations in the ccp condition of Eq. (ISal) correspond- 
ing to the "black squares" in on-diagonal 4x4 blocks are 
given by 



1 7 



1 3 



(7) 



for all rrii, rrij, ruk appearing together in a 1 -IN-3S AT clause. 
Since the rric are integers, these inequalities are exactly equiv- 
alent to the 1-IN-3SAT constraints given in Eq. (7) of the 
main text. 

We have successfully encoded the correct coefficients and 
constants into certain matrix elements of B^'^'> and Q. But all 
the other elements of these matrices also generate inequalities 
via Eq. dSah . To "filter out" these unwanted inequalities, we 
choose the remaining diagonal elements and all off-diagonal 
elements of the symmetric matrix 5* to be large and positive, 
thereby ensuring all unwanted inequalities are always trivially 
satisfied. 

L,n, as constructed so far, will not satisfy the normalisation 
condition (ii) given on page 3 of the main text. For that, we 
need to ensure that w^Q = 0, i.e., that the columns of Q 
sum to zero. We use the "white squares" of Q, generated by 
the diagonal elements in the third tensor factors of Eq. (l3|), 
to renormalise these column sums to zero. Recall that both 
{vr} and {vc, Vc'} are complete sets of mutually orthogonal 
vectors. Rearranging Eq. (jj), Q is therefore given by 



Q = fcl + S"® 



1 1 
1 1 



® 



+ E ^-""^ 



1 1 
1 1 

1 
-1 



® 



(8) 



where 1 is the identity matrix. Now, the only requirement 
on the off-diagonal elements of S is that they be sufficiently 
positive to filter out the unwanted inequalities. Also, from the 
form of Eq. ([sl), the columns in any individual 4x4 block of 
Q sum to the same value. Thus, by adjusting the elements of 
S, we can ensure that all columns of Q — fcl sum to the same 
positive value, a say. Choosing k = —a, the negative on- 
diagonal element in each column generated by the fcl = — crl 
term will cancel the positive contribution from the other terms, 
thereby satisfying the normalisation condition, as required. 

Finally, we must ensure that the second ccp condition from 
Eq. dSbl) is always satisfied, for which we require the following 
Lemma: 

Lemma 1 IfQ — — fcl is d- dimensional, then for any real k 
there exists a matrix P such that diag P ~ Q and 



(1 - ww^){Q + P)(l - ww^) > 0, 



(9) 



where w = (1,1,..., l)"^ /vd. 

Proof Choose P = a(l — ww^) + a(l — d)ww^ . Then the 
diagonal elements of P are 



P^.^=a 1- 



1 



+ a(l-d)- = 0. 



(10) 



and 



{l-ww^){Q + P)il-ww^) = {a-k){l-ww^), (11) 



which is positive semi-definite for a > k. 



D 



The coefficients Pij in Eq. (yj) can be chosen freely, since they 
play no role in either the normalisation or in encoding 1-lN- 
3 SAT, so the [ofFdg P] term in the ccp condition of Eq. dSbl) 
can be chosen to be any matrix with zeros down its main di- 
agonal. Also, from Eq. (jsl), all diagonal elements of Q are 
equal to fc = —a. Thus Eq. dSbl) is exactly of the form given 
in Lemma [ij, and choosing P accordingly ensures that it is 
always satisfied. Furthermore, since gives a P^ that is Hermi- 
tian, condition (i) of the main text is automatically also satis- 
fied. 

We have constructed Lq and A'^^ such that there exists an 
Ljn satisfying conditions (i), (ii) and (iii) from page 3 of the 
main text if (and only if) the original 1 -IN- 3 SAT instance was 
satisfiable. But we have already shown that condition (iii), 
along with conditions (i) and (ii), are satisfied if (and only if) 
i,„ is of Lindblad form, which in turn is equivalent to £' = 
g-Lm _ g-Lo being Markovian. 

Furthermore, the integer solutions of Eqs. (|7|) are insensitive 
to small perturbations of the coefficients and constants, so any 
sufficiently good approximation E' will still be Markovian if 
E is, and vice versa, as long as we impose sufficient precision 
requirements. Indeed, it is natural to expect that if a snapshot 
E is close to being Markovian, it will have a generator _L,„ 
that is close to being of Lindblad form. Making this rigorous 
is less trivial, but follows from continuity properties of the 
matrix exponential ll{| and logarithm 12|]. The Markovianity 
problem is therefore equivalent to the problem of determining 
whether any L„i obeys the three conditions (i) to (iii), up to the 
necessary approximation accuracy. Thus we have successfully 
encoded 1-IN-3SAT into the Liouvillian problem, such that 
the corresponding snapshot E is Markovian if (and only if) 
the 1- IN- 3 SAT instance was satisfiable. 

Using standard perturbation theory results for eigenvalues 
and eigenvectors |l3l|4|], a careful analysis reveals that a preci- 
sion of 0{V~^{C + 2V)~^) is sufficient, which scales only 
polynomially with the number of degrees of freedom in the 
system (i.e., with the size of the Liouvillian matrix). Though a 
polynomial scaling is not strictly speaking necessary to prove 
NP-hardness, it makes the result more compelling, as it shows 
that the complexity does not result from demanding unreason- 
able precision requirements. This is sometimes called strong 
NP-hardness of a weak-membership problem (cf. Ref. jSl]). 

This so-called weak-membership formulation of the 
problem — allowing for approximate answers — is vital if the 



question is to be reasonable from an experimental perspective: 
the snapshot E can only be measured up to some experimen- 
tal error. Allowing for approximate answers can only make 
the problem easier than requiring an exact answer, so the fact 
that the problem remains NP-hard even for finite (even polyno- 
mial) precision is crucial to the experimental relevance of the 
hardness result. In fact, the weak-membership formulation is 
also necessary from a theoretical perspective. If E happened 
to be close to the boundary of the set of Markovian maps, then 
it would be close to both Markovian and non-Markovian maps, 
and an exact answer could require the matrix elements of E to 
be specified to infinite precision, which is not reasonable even 
theoretically. 



Several snapshots 



Clearly, if we can find a set of dynamical equations when- 
ever they exist, we can also determine whether they exist. So 
finding the dynamical equations is at least as hard as answer- 
ing the existence question. For a single snapshot, the latter is 
just the Markovianity problem again. But, having constructed 
Lq and A''-^'^ as described above, it is easy to generalise this 
to any number of snapshots £t'- simply take Et = e^"* for as 
many different times t as desired. 



The classical setting 

The analogue of the Markovianity problem in the classical 
setting is known as the embedding problem. Given a stochas- 
tic matrix, this asks whether it can be generated by any contin- 
uous, time-homogeneous Markov process (i.e., by dynamics 
obeying a time-independent classical master equation). The 
quantum mechanical proof described above does not directly 
imply anything about the classical problem (nor vice versa). 
Nevertheless, it turns out that the arguments used in the quan- 
tum setting can readily be adapted to the classical embedding 
problem. 

We can reduce the embedding problem to a question about 
the (classical) Liouvillian, in the same way as in the quantum 
case. Comparing the conditions for L to be a valid classical Li- 
ouvillian (see conditions (i) and (ii) on page 1 of the main text) 
with the matrices Q and B^'^^ from Eqs. \^ and (|4J), we see 
that Q + X) "^c-B'^'^•' is a valid classical Liouvillian if and only 
if the 1-IN-3SAT problem was satisfiable. In other words, 
for the classical case, we simply need to use the matrices Q 
and B'''^\ rather than the full matrices Lq and A''^'> used in 
the quantum construction. The rest of the arguments proceed 
as in the quantum case, thereby proving that the embedding 
problem too is NP-hard. 
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